Search for: All records

This paper presents the design of a multimodal chatbot for use in an interactive theater performance. This chatbot has an architecture consisting of vision and natural language processing capabilities, as well as embodiment in a non-anthropomorphic movable LED array set in a stage. Designed for interaction with up to five users at a time, the system can perform tasks including face detection and emotion classification, tracking of crowd movement through mobile phones, and real-time conversation to guide users through a nonlinear story and interactive games. The final prototype, named ODO, is a tangible embodiment of a distributed multimedia system that solves several technical challenges to provide users with a unique experience through novel interaction. 

Abstract Periodical cicadas exhibit an extraordinary capacity for self‐organizing spatially synchronous breeding behavior. The regular emergence of periodical cicada broods across the United States is a phenomenon of longstanding public and scientific interest, as the cicadas of each brood emerge in huge numbers and briefly dominate their ecosystem. During the emergence, the 17‐year periodical cicada speciesMagicicada cassiniis found to form synchronized choruses, and we investigated their chorusing behavior from the standpoint of spatial synchrony.Cicada choruses were observed to form in trees, calling regularly every five seconds. In order to determine the limits of this self‐organizing behavior, we set out to quantify the spatial synchronization between cicada call choruses in different trees, and how and why this varies in space and time.We performed 20 simultaneous recordings in Clinton State Park, Kansas, in June 2015 (Brood IV), with a team of citizen‐science volunteers using consumer equipment (smartphones). We use a wavelet approach to show in detail how spatially synchronous, self‐organized chorusing varies across the forest.We show how conditions that increase the strength of audio interactions between cicadas also increase the spatial synchrony of their chorusing. Higher forest canopy light levels increase cicada activity, corresponding to faster and higher‐amplitude chorus cycling and to greater synchrony of cycles across space. We implemented a relaxation‐oscillator‐ensemble model of interacting cicadas, finding that a tendency to call more often, driven by light levels, results in all these effects.Results demonstrate how the capacity to self‐organize in ecology depends sensitively on environmental conditions. Spatially correlated modulation of cycling rate by an external driver can also promote self‐organization of phase synchrony.